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Angular dependent magnetothermal conductivity experiments on CeCoIns indicate that this com- 
pound is a d I .2_ !/ 2-wave superconductor. In this study, the low-temperature behavior of the upper 
critical field is measured in a single crystal of CeCoIns along the directions H \\ a and H \\ c. The data 
is compared with model calculations of the upper critical field in a d a .2_ !/ 2-wave superconductor. It 
is found that the observed H C 2(T) along H || a is consistent with a Fulde-Ferrell-Larkin-Ovchinnikov 
(FFLO) state at low temperatures, T < 0.7K, whereas for H || c the FFLO state appears to be 
absent in CeCoIns. Furthermore, it is predicted that the quasiparticle density of states in the 
FFLO state exhibits a complex peak structure which should be observable by scanning tunneling 
microscopy. 



I. Introduction 

Recent measurements on CeCoIns have led to a renewed discussion of a possible high-field Fulde-Ferrell-Larkin- 
Ovchinnikov (FFLO) state in unconventional superconductors. [1,2] In this state, the coupling of the magnetic field 
to the quasiparticle spins dominates over the orbital coupling, leading to pairing between exchange-split Fermi sur- 
faces, and hence to a spatially non-uniform superconducting order parameter. For conventional superconductors, 
its realization appears to be practically impossible because of two reasons. First, the sample quality has to be in 
the superclean limit, i.e. the quasiparticle mean path needs to be much larger than the coherence length. Second, 
the Ginzburg-Landau parameter k, measuring the ratio of the magnetic penetration depth vs. the superconducting 
coherence length, should be very large, i.e. n 10. 

The recent synthesis of quasi-two-dimensional nodal superconductors, such as the high-T c cuprates, the k-(ET)2 
salts, and CeCoIns has changed this situation dramatically. It appears that the above two conditions can be met 
in high-quality single crystal samples of these compounds. [3-6] These systems are quasi-two-dimensional, leading 
to a large Ginzburg-Landau parameter in a planar magnetic field. Furthermore, unlike in the conventional s-wave 
superconductors, the stability region of the FFLO state is much more extended in d a; 2_ 1( 2-wave superconductors 
compared to conventional ones. [3,4] 

Indications for possible FFLO states in organic superconductors were already reported in A-(BEDTS)2GaCLi and 
k-(BEDT-TFF)2Cu(NCS)2- [7,8] In the first compound, a kink in the thermal conductivity points to a transition 
from a FFLO state to a vortex lattice. In the second material a similar feature in the magnetization was identified. 
Moreover, recent evidence for d^^^-wave order parameter symmetry was found in k-(BEDT-TFF)2Cu(NCS)2 by 
angular dependent magnetothermal conductivity measurements in a rotating magnetic field within the conducting 
crystal plane. [9,10] Moreover, it was observed that the upper critical field H C 2(T) in the FFLO regimes decreases 
quasi-linearly with temperature, in contrast to the rather weak temperature dependence of H C 2 in the absence of a 
FFLO state as T -> 0. 

More recently, a new heavy fermion compound, CeCoIns, was discovered. This material superconducts below a 
critical temperature T c = 2.3K, [11] and it has a layered structure similar to the high-T c cuprates. Angular dependent 
magnetothermal conductivity experiments indicate d x 2_ y 2-wave superconductivity in this material. [12] Furthermore, 
the temperature dependence of the upper critical field H c2 (T) for both H \\ a and H \\ c was measured in single 
crystals of CeCoIn 5 . [13] It was observed that H c2 (T) for H \\ a exhibits a quasi-linear temperature dependence in 
the proposed FFLO regime, T < 0.7K. 

In this paper, the upper critical field H C 2(T) in a single crystal sample of CeCoIns is determined from thermal 
expansion and magnetorestriction measurements with field orientations H || a and H \\ c. A d x 2_ y 2--w&ve model 
calculation is used to explain the temperature dependence of H C 2(T) along both directions, considering the orbital 
effect and the Pauli term. In particular, the possibility of a FFLO state is addressed. For H || c it is found that 
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the temperature dependence of H C 2(T) can be fitted consistently to the experimental data without invoking a FFLO 
state. On the other hand, for H \\ a we observe that the inclusion of a v ■ q term arising from a FFLO state is crucial 
for a consistent description of the observed H c2 (T) below T = 0.7K. In particular, the quasi-linear T-dependence of 
H C 2(T) at low temperatures can be understood within this framework, which provides compelling evidence for a FFLO 
state in CeCoIn 5 . In order to help to further test and scrutinize this model, we also determine the corresponding 
quasiparticle density of states which should be accessible to scanning tunneling microscopy experiments. 



II. H c2 (T) for H || c 



The temperature dependence of the upper critical field along the crystal c-direction can be obtained from two 
coupled integral equations [14] 
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where t = T/T c , p = (v 2 eH)/(8ir 2 T 2 ), and h = (gpsH) / '(2irT). Here it is assumed that the wave function of the 
Abrikosov state for a d a ,2_ y 2-wave superconductor can be written as 



I*) = (l + C(at) 4 ) |0>, 



(3) 



where the "vacuum" |0) is the Abrikosov state of an s-wave superconductor, and is the raising operator of the 
Landau level. In other words, |0) is a combination of the N = Landau states. For d^^-wave superconductors 
an admixture of higher Landau states that are allowed by symmetry needs to be included in order to account for 
structural changes in the vortex lattice. 
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FIG. 1. Temperature dependence of (a) the upper critical field and (b) the admixture parameter C in a A x 2_ 
superconductor with g-factors g=0, 1.5, and 2. The magnetic field is applied along the crystal c-direction. 



In Fig. 1(a), experimental data of H C 2(T) along the c-axis in CeCoIns is compared with the numerical solution of 
Eqs. 1 and 2, describing a d^^-wave vortex lattice. The temperature dependence of the upper critical field H C 2(T) 
is extracted from low-temperature thermal expansion, Al(T,B = const), and magnetostriction Al(B,T = const) 
measurements utilizing a high-resolution capacitive dilatometer at temperatures down to 15 mK and in magnetic 
fields up to 18 T. [15] For temperatures above T s=a 0.7 K, the superconducting-to-normal phase transition is of second 
order and the H C 2(T) is determined from the midpoint of idealized jumps in dAl/dT and dAl/dB. Below T sharp 
jumps in Al are observed upon crossing H C 2(T) 7 indicative of a first order phase transition [24]. The best fit with a 
numerical solution of Eqs. 1 and 2 is obtained with v = 3.2738 x 10 8 cm/sec, and g—l-5. For comparison, solutions 
with the same Fermi velocity v, but g— and 2 are also shown. The fit to the experiment appears to be very good in 
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the low-temperature regime T <0.7K. Therefore, there are presently no obvious indications for a FFLO state in this 
material by measurements of _ff c2 (T) along the crystal c-direction. 

In Fig. 1(b) we show the numerical solution for the admixture parameter C. Interestingly for g> 1.2, C changes 
its sign as the temperature is decreased. Consequently, for g= 1.5 one finds that the conventional hexagonal vortex 
lattice, which is stable at high temperatures, may change into a square vortex for T/T c < 0.3. This transition should 
be observable by small angle neutron scattering (SANS) with H \\ c. A similar instability to a square vortex lattice 
was previously predicted for the high-T c cuprates in the vicinity of H C 2- [14] Both, SANS [16] and STM [17] on the 
vortex state of YBCO single crystals indeed indicate significant deviations from a hexagonal towards a square vortex 
lattice in this compound. [18] Furthermore, the above theory was recently extended to lower magnetic fields. [19] The 
predicted square vortex lattice was observed by SANS in a single crystal of LSCO at H=2 Tesla. [20] 

III. H c2 (T) for H || a 



In order to match the experimental data for H C 2(T) along the crystal a-axis, we explore the effect of a v ■ q term 
arising from the formation of a FFLO state. [21] This leads to a new set of coupled integral equations, 
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where s = sinx + ism/p, p = (vv c eH) / (8n 2 T 2 ) , pcoscfi = (v ■ q)/(2h), \ = ck z , and (...) is the angular average over 
and x- Here y/vv c — 1.63 x 10 8 cm/s is used, and following Gruenberg and Gunther [22], we chose q\\ H || a. In this 
configuration, the vortex state is represented by 



I*) = (l + C(at) 2 ) |0), 
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where the vacuum |0) is again the Abrikosov state of a simple s-wave superconductor [22], but mixing now occurs 
with the N=2 Landau level. 
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FIG. 2. Temperature dependence of (a) the upper critical field, (b) the v ■ q/(2H) = pcoscj) term, and (c) the admixture 
parameter C in a d 2 .2_ y 2-wave superconductor with g-factors g= 0.64 (solid lines) and 2 (dashed lines). In (a) the lower curves 
represent p — 0, i.e. absence of FFLO, whereas the upper curves have p = 0.9. The magnetic field is applied along the crystal 
a-direction. The experimental data (circles) is best described by g=0.64 and p = 0.9. 



Furthermore, let us note that for the purpose of In Fig. 2(a) H c2 (T) is shown for g= 0.64 and 2 along with the 
measurements of the upper critical field along the a-axis of CeCoIns. We find that without the FFLO state (p = 0) 
one obtains a good fit to the experiment down to T = 0.7K with g=0.64. However, for T < 0.7K the measured upper 
critical field is approximately linear in temperature. This feature can be reproduced by including a v ■ q term due to 
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the FFLO state with p = 0.9. For comparison, we also show results for g = 2 which yield a zero-temperature critical 
field that is less than half the value detected in the experiment. In Fig. 2(b) p(t) is shown for g = 0.64 and g = 2. 
From this plot it is clear that the FFLO region expands as g is increased. In Fig. 2(c) the coefficient C(t) is shown. 
Here we observe that C exhibits a significant temperature dependence for g — 2, whereas for g = 0.64 the admixture 
is almost negligible. [23] 

Furthermore, let us note that for the purpose of the present discussion it was assumed that the transition at H = H C 2 
is of second order. However, a number of experiments on CeCoIns indicate a possible first order transition, and onset 
of magnetic order at T < 0.8K. [12,13,24,25] At the moment the nature of this magnetic order is unknown. In case 
it is a spin density wave, the condensation energy is expected to be relatively small, and consequently its effect on 
H c2 (T) should be small as well. [28] 

IV. Quasiparticle Density of States 



Let us conclude this discussion of a possible FFLO state in CeCoIn 5 by calculating the shape of the associated 
quasiparticle density of states. In the vicinity of H = H c2 and for H || a this observable is well approximated by [6] 
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where H = (/j,BgH)/2, \s\ = ysin 2 (</>) +sin 2 (x), and e = \Jvv c eH. Again, a finite p indicates the presence of a 
FFLO state. This quasiparticle density of states is plotted in Fig. 3. For the parameters, we have chosen p = 0.9 
and e/h = 0.2, appropriate for CeCoIn 5 in the temperature regime T < 0.1K . In the absence of the FFLO state (Fig. 
3(a)), there are two sharp resonances close to E = ±H. In the presence of the FFLO state, more structure appears in 
the spectral response, as shown in Fig. 3 (b), with resonances at E = ±H(l ±p). Therefore, precision measurements 
of the quasiparticle density of states can provide a clear signal for the presence of FFLO states and the symmetry 
of the underlying superconducting order parameter. It should thus be of interest to conduct a scanning tunneling 
microscope study of the quasiparticle density of states in CeCoIn 5 at T < 0.7K in order to further scrutinize the 
proposed FFLO state. 
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FIG. 3. Quasiparticle density of states of a d x 2_ y 2-w&ve superconductors in a magnetic field, (a) in the absence of the FFLO 
state (p = 0), and (b) in the FFLO state (p = 0.9). 



V. Conclusions 



In summary, the model calculation in this study incoporates consistently (i) the d a ,2_ y 2-wave symmetry of the 
superconducting order parameter, (ii) the orbital effect, and (iii) a v ■ g-term due to the formation of a FFLO state. 
The model appears to describe well the observed temperature dependence of the upper critical field in CeCoIn 5 . 
Furthermore, it indicates a significant renormalization of the g-factor in this compound, as well as the presence of 
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a FFLO state at low temperatures if the applied field has an in-plane component. In this phase, the quasiparticlc 
density of state is predicted to have a more complex structure. In order to further scrutinize the proposed model, it 
will be interesting to determine further relevant properties, such as the specific heat and the thermal conductivity. 
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